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(54) Title: A SYSTEM AND METHOD FOR DISTRIBUTED COLLABORATIVE DRAWING 



(57) Abstract 

The present invention pertains to a system and method for 
managing a real-time distributed collaborative drawing activity 
(100). A community of collaborators associated with client 
computers (102) are connected via a communications link (106) 
with a server computer (104). Each collaborator contributes to the 
real-time design of a shared drawing (120) that is displayed in 
each collaborator's virtual whiteboard. Contributions to the shared 
drawing (120) as well as communications between the collaborators 
are transmitted to the server computer (104). The server computer 
(104) broadcasts the communication to each of the collaborators 
engaged (136) in the design activity. Each user has a set of drawing 
tools (132) that are used to generate a variety of drawing strokes that 
edit the shared drawing. A curve generating procedure (122) is used 
to capture the manner in which the user draws the stroke in order to 
emulate a selected drawing tool. A compact representation of the 
user's stroke is generated and transmitted to each collaborator. 
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A SYSTEM AND METHOD FOR DISTRIBUTED COLLABORATIVE DRAWING 

The present invention relates generally to distributed computing systems and 
particularly to a system and method for managing a distributed collaborative design 
activity. 

BACKGROUND OF THE INVENTION 

Interactive conferencing systems provide users residing in disparate geographic 
locations the capability to participate in a real time design activity. Typically each 
user or participant is associated with a computer that is networked with the computers 
of the other participants. A display device associated with each user is used as a 
virtual whiteboard to display and receive drawings and other communications 
pertinent to the collaborative design activity. Each participant has the same copy of 
the shared drawing in its whiteboard. Each participant engages in the design activity 
by adding or editing the shared drawing. Alterations to the shared drawing are 
quickly transmitted to each participant in order to maintain a consistent state of the 
shared drawing amongst the participants. Thus, the success of such a system relies 
on an efficient methodology for quickly relaying graphical images to each of the 
participants. 

SUMMARY OF THE INVENTION 

The technology of the present invention pertains to an apparatus and method for 
supporting a real-time computer-networked collaborative design activity. The 
collaborative design activity includes a community of users that communicate with 
one another through client computers interconnected via a computer network such as 
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the Internet. In an embodiment of the present invention, the collaborative design 
activity is a shared drawing activity between a community of users within the 
architecture engineering construction (AEC) industry. Each user utilizes a video 
display as a virtual whiteboard to engage in the collaborative design of a shared 
drawing. 

Each user or collaborator in the collaborative drawing session has its own copy of the 
shared drawing. Each user can edit the shared drawing. Each user's alterations are 
captured and transmitted to the server computer. The server computer then 
broadcasts the alterations to each of the client computers associated with a 
collaborator. Each collaborator receives the alterations which are then incorporated 
into their copy of the shared drawing. 

Each collaborator is provided with a set of drawing tools that can be used to add or 
delete lines and curves to the shared drawing. Each drawing tool has associated with 
it a specific style. The present technology captures the manner in which a user draws 
a stroke in order to emulate the style of the drawing tool used to draw the stroke. 

A collaborator uses a pointing device to draw a stroke. Location data points are used 
to represent the path of the stroke. The location data points are then used to 
generate curve points representing the curve in accordance with a specified 
resolution. The curve points are used to display an image of the curve. In addition, 
curve descriptors are generated which are a compact representation of the shape of 
the curve. The curve descriptors are transmitted to the server computer for broadcast 
to the other collaborators. A collaborator receiving the curve descriptors translates 
them into curve points in order to display the image in the collaborator's virtual 
whiteboard. 

The speed and pressure at which portions of the stroke are drawn is used to emulate 
the natural style of the drawing tool used in drawing the stroke. Time data points 
and/or pressure data points can be received from a pointing device used to generate 
the user's stroke. The time and/or data points can be used to emulate the drawing 
tool's natural style. The natural style of a drawing tool can be manifested in the 
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varying color hues, texture, and thickness of the stroke. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Additional objects and features of the invention will be more readily apparent from the 
following detailed description and appended claims when taken in conjunction with 
the drawings, in which: 

Fig. 1 is a block diagram of a computer system incorporating the preferred 
embodiments of the present invention. 

Fig. 2 shows a server computer system according to an embodiment of the present 
invention. 

Fig. 3 is a schematic representation of an exemplary video display screen used in an 
embodiment of the present invention. 

Figs. 4A - 4D are schematic representations of menu selection items used in an 
embodiment of the present invention. 

Fig. 5 is a flow chart of the steps used to capture and transmit drawing alterations 
made during a collaborative design activity. 

Figs. 6A - 6E are schematic representations of the steps used to trace the path of a 
curve drawn in a shared drawing. 

Fig. 7 is a flow chart of the steps used to draw a curve in a shared drawing. 

Fig. 8 illustrates the steps used by the image generation procedure in displaying an 
image. 

Figs. 9A - 9c are schematic representations of steps used to erase a portion of a 
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shared drawing. 

Fig. 10 is a flow chart of the steps used to erase a portion of a shared drawing. 
Figs. 1 1 A - 1 1C are illustrations of curves used to generate a set of parallel lines. 
Fig. 12 illustrates the steps used to generate a set of parallel lines. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
System Architecture 

The technology of the present invention pertains to an apparatus and method for 
supporting a real-time computer-networked collaborative design activity. The 
collaborative design activity includes a community of users that communicate with 
one another through client computers interconnected via a public computer network 
such as the Internet. The communications between each participant includes all 
media forms that can be transmitted via a computer network. Examples of such 
media can include, but are not limited to, text, video, sound, and/or graphical images. 
A server computer is used to coordinate the transmission of the communications 
between each participant. 

In an embodiment of the present invention, the collaborative design activity is a 
shared drawing activity between a community of users within the architecture 
engineering construction (AEC) industry. Each user utilizes a video display as a 
shared drawing space that can display one or more drawings. These drawings can 
include computer-aided design (CAD) drawings, construction blueprints, architectural 
drawings, computer-designed graphic images, and the like. 

Each user or collaborator in the collaborative drawing session has its own copy of the 
shared drawing. Each user can edit the drawing using one or more graphic devices, 
such as but not limited to, a mouse or other pen pointing device. A collaborator can 
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edit the shared drawing by adding a new drawing to it, change a part of the existing 
shared drawing, or perform other edit changes. The alterations to the drawing by 
each user are then captured and transmitted to the server computer. The server 
computer then broadcasts the alterations to each of the client computers associated 
with a collaborator. Each collaborator receives the alterations and incorporates them 
in their copy of the shared drawing. 

In addition, each collaborator can send text messages to other collaborators. A 
dialogue or chat box is provided which allows real-time text-based messages to be 
communicated between one or more collaborators during the shared drawing session. 
In other embodiments of the present invention, messages including video and audio 
data can also be transmitted between the collaborators. 

Referring to Fig. 1, a system 100 representing a preferred embodiment of the present 
invention includes a number of client computers 102 and one or more server 
computers 104 in communication via a communications link 106. The communication 
link 106 generically refers to any type of wire or wireless link between computers, 
such as but not limited to a local area network, a wide area network, or a combination 
of networks. In a preferred embodiment of the present invention, the communications 
link 106 can be a network such as the Internet. 

A client computer 102 includes a central processing unit (CPU) 108, a user interface 
110, a memory 114, and a communications interface 112. The client computer 102 
can be any type of computing device, such as but not limited to, desktop computers, 
workstations, laptops, and/or mainframe computers. One or more users (not shown) 
can be associated with each client computer 102. The communications interface 112 
is used to communicate with other client computers 102 as well as other system 
resources not relevant here. 

The user interface 110 can consist of any type and number of input/output (I/O) 
devices, such as but not limited to, a video display device, printing devices, a 
keyboard, a mouse, pen pointing devices, graphic tablets (such as a WACOM 
pressure sensitive graphics tablet), and the like. 
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The memory 114 of the client computer 102 may be implemented as RAM (random 
access memory) or a combination of RAM and non-volatile memory such as magnetic 
disk storage. The memory 1 14 of the client computer 102 can contain the following: 

• an operating system 116; 

• network access procedures 118. In an embodiment of the present invention, 
the network access procedures 118 can be used to implement a communications 
protocol that is suitable for transmitting data through the Internet, such as the 
Transmission Control Protocol and the Internet Protocol (TCP/IP); 

• an interactive drawing procedure 120 that manages the collaborative design 
activities between several client computers 102; 

• one or more session transcripts 136. Each session transcript 136 stores a 
transcription of the events that occur during a collaborative design activity. A 
particular session transcript 136 can be replayed at a later point in time; 

• a drawing repository 138 that stores one or more drawings 140. A drawing 140 
can be stored in any computer-generated image or graphic file format, such as but 
not limited to BMP, DXF, HPGL, DIB, TGA, GIF, TIF, PCX, JPG, and the like; and 

• other procedures and data structures. 

The interactive drawing procedure 120 can contain the following: 

• one or more curve engine procedures 122. Each curve engine procedure 122 
is used to generate the curve descriptors and curve data points used to represent a 
curve; 

• image generation procedure 124 that display images onto any type of I/O 
device, such as a video display device; 

• session transcript procedures 1 26 that record portions of or the entire design 
activity session into a session transcript 136. In addition, the session transcript 
procedures 126 enable a user to replay a particular session transcript 136 at a later 
point in time; 

• conferencing procedures 128 that manage the exchange of communications 
between each collaborator during a design activity session; 

• conversion procedures 130 that convert an incoming drawing stored in a 
particular file format into a format suitable for use by the interactive drawing 
procedure 120; 
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• menu display procedures 132 that manage the drawing facilities provided to a 
user; and 

• distance mapping procedures 134 that map a time and/or pressure value into 
an equivalent measure of distance; 

• as well as other procedures and data structures. 

Referring to Fig. 2, there is shown a server computer 104 including a central 
processing unit (CPU) 202, a user interface 204, a memory 208, and a 
communications interface 206. The memory 208 of the server computer 104 can 
contain the following: 

• network access procedures 210. In an embodiment of the present invention, 
the network access procedures 210 can be used to implement a communications 
protocol that is suitable for transmitting data through the Internet, such as the 
Transmission Control Protocol and the Internet Protocol (TCP/IP); 

• an operating system 212; and 

• other procedures and data structures. 

The operating system 212 of the server computer 104 utilizes broadcasting 
procedures 214 that manage the conferencing activities between the various client 
computers 102 engaged in the collaborative design activity. In an embodiment of the 
present technology, the UNIX operating system is used which supports a multi-user 
backbone (M-bone) or network ability that allows multiple client computers 102 to 
connect to a particular server computer 104. However, it should be noted that the 
present invention is not limited to this particular type of operating system or 
broadcasting facility. Others can be used so long as they provide the same 
functionality. 

The server's operating system procedures 212 utilizes a network port to support a 
number of communication streams that are used to transmit data between the client 
computers 102 engaged in the collaborative design activity. The server's operating 
system 212 receives transmissions from one or more client computers 102 and routes 
them to the intended client computers 102. Initially, a client computer 102 sends a 
request to the server computer 104 to connect. The request contains the Internet 
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address of each client computer 102 of a collaborator. The server computer 104 
makes the connection and establishes a stream representing a connection between 
the client computer 102 with its network port. This stream allows communications to 
be transmitted rather rapidly between the server computer 104 and the particular 
client computer 102. 

Each collaborator participates in a collaborative drawing activity by utilizing the video 
display as a "virtual" whiteboard. The whiteboard can display any and all graphic 
images that are part of the collaborative drawing activity. Fig. 3 illustrates an 
exemplary screen display in accordance with an embodiment of the present invention. 
The interactive drawing procedure 120 displays the virtual whiteboard 302 along with 
a menu bar 304, a dialogue box 306, and a text input box 308. The virtual whiteboard 
302 can consist of one window illustrating a particular drawing 310, can include 
multiple windows (not shown) with each window focusing on a particular aspect of the 
drawing 310, or multiple windows (not shown) with each window displaying a different 
drawing. The dialogue box 306 is used to display text messages that are transmitted 
and received during a collaborative drawing session. The text input box 308 is used 
by a user to insert text messages that are distributed via the server computer 104 to 
the other collaborators of the collaborative drawing session. 

Each collaborator can utilize a different type of video display device. For this reason, 
each collaborator's whiteboard is presumed to be of a standard size and is scaled, if 
necessary, to accommodate the dimensions of a particular collaborator's video 
display device. 

Each collaborator can edit the drawing in a variety of ways using different tools 312 to 
draw different objects, lines, strokes, shapes, and the like. A menu display procedure 
132 provides a number of facilities that enable the user to edit a drawing in an 
intended manner. Figs. 4A - 4D illustrate an exemplary list of such facilities. For 
instance, the user can select a particular drawing tool 312 from a menu that includes, 
but is not limited to, the following tools: a fine pen, a wet brush, a watercolor brush, a 
pencil, a charcoal pen, an etch device, a straight edge, a crayon, a piece of chalk 
and/or a rollover. A user can use a particular tool to draw a stroke or text in its 
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whiteboard. In addition, one or more templates of predefined shapes 314 or objects 
is provided for the user. The style of each stroke, shape, or text can be associated 
with one or more styles 318 and/or textures 316. The textures 316 can represent 
various fill patterns. In an embodiment of the present invention, the textures 316 can 
represent materials used in the AEC industry. For instance, a diagonal cross-hatch 
texture can represent concrete, a orthogonal cross-hatch texture can represent 
ceramic title, and so forth. 

The general architecture and processing associated with the interactive collaborative 
design activity has now been disclosed. Attention presently turns to the curve 
generating techniques associated with the present technology. 

Curve Generating Method 

In the collaborative drawing session of the present invention, each user can edit the 
shared drawing. Typically, a user edits the drawing by adding or deleting strokes to 
the shared drawing. A pointing device is used to trace the path of the user's stroke. 
The pointing device represents the path as a number of position data points. The 
position data points are then mapped into curve descriptors which are a concise 
representation of the Bezier curves that form the stroke. In addition, the stroke is also 
represented by a number of curve points that are used by the image generation 
procedure to display the stroke. The curve descriptors are transmitted to the server 
computer and broadcasted to the other collaborators. 

In some instances, time and pressure data points are received along with the position 
data points. The time data points reflect the speed at which the stroke was generated 
and the pressure data points reflect the pressure used to generate the stroke. The 
time and pressure points are used to capture the natural style of the drawing tool 
used to draw the stroke. The natural style of a drawing tool is manifested by the 
varying color hues in the stroke, by the width of the stroke, and by the texture of 
stroke. For instance, segments of a stroke drawn fast are represented by a darker 
hue or texture than segments that are drawn slower. In addition, segments of a 
stroke that are drawn fast are often thinner than those drawn slowly. Likewise, the 
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pressure of a stroke can effect the color hue, texture, and width characteristics. For 
example, segments of a stroke that are generated with heavy pressure can be 
reflected with a darker hue, darker texture and with a wider shape. By contrast, a 
lightly drawn stroke can be reflected with a lighter hue, lighter texture and with a 
thinner shape. 

The characteristics of each drawing tool varies. As such, the time and pressure data 
points are used differently to reflect the natural style of a particular drawing tool. For 
example, pressure has an effect on the stroke that is generated by a water color 
brush but speed may not. The pressure used to draw a stroke with a water color 
brush will affect the width of the stroke but not the hue. By contrast, pressure and 
speed affect the style of a wet paint brush stroke. The more pressure that is used to 
draw the stroke, the thicker and darker the stroke becomes. Similarly, the faster the 
stroke is drawn, the thicker and darker the stroke becomes. 

The curve generating method of the present technology traces the path of a user's 
stroke and generates a curve from it. The curve is represented as a set of curve 
points and as a set of curve descriptors. The curve points are used to display the 
image in accordance with user-defined directives. The user-defined directives can 
specify the curve's resolution and the curve characteristics relative to a particular 
drawing tool. 

"The curve descriptors define the shape of the curve. Three curve descriptors are 
used to represent a curve: a first descriptor represents a starting point of the curve; a 
second descriptor represents the shape of the curve; and a third descriptor 
represents an ending point of the curve. The curve descriptors are transmitted to the 
collaborators of a collaborative drawing session. The curve descriptors are 
transmitted rather than the position data points in order to minimize the amount of 
data that is transmitted between the collaborators. In this manner, the speed of the 
transmission is increased and relatively low bandwidth transmission links can be 
utilized without compromising the speed at which drawing updates are broadcast. 

The curve generating method of the present technology differs from curve fitting 
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techniques. Curve fitting techniques "fit" or generate a curve from a set of user- 
defined control points that describe the shape of the curve. The control points are not 
necessarily part of the curve. By contrast, the present technology receives a curve 
and translates it into another curve in accordance with one or more user-defined 
directives (i.e., resolution value and drawing tool). 

Prior to discussing the details of the curve generating methods, a brief synopsis of 
the method is described first followed by a glossary of terms used in this document 
concerning the curve generating method. The curve generating method utilizes 
Bezier curve methods which are well-known in the art. A more detailed description of 
the Bezier curve methods can be found in Newman and Sproull, Principles of 
Interactive Computer Graphics . 2d edition, McGraw-Hill Book Company, which is 
hereby incorporated by reference as background information. 

The curve generating method maps position data points received from a pointing 
device into a set of curve data points that define one or more Bezier curves. The 
curve engine 122 performs this mapping in real time and is sensitive to real-time 
processing constraints. 

A stroke is represented as a series of second degree Bezier curves. Each Bezier 
curve is represented by a mathematical function q(u). The function q(u) is defined 
over a set of evenly-distributed intervals represented by the vector u. Each interval u } 
is a real number within the range between 0 to 1 . The number of intervals, n, effects 
the resolution of the curve. The number of intervals can be either a user-defined 
value or determined from the curve engine 122. In order to process the position data 
points in real time, the curve engine 122 may adjust the number of intervals in order 
to meet the demands of real-time processing. 

Time and pressure data points can also be received from the pointing device. These 
data points are also transformed into a series of second degree Bezier curves in 
accordance with the same mathematical function q(u). The time and pressure Bezier 
curves are used by the image generation procedure 124 to generate an intended 
image of the curve. 
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To assist the reader, the following glossary of terms is used to describe the curve 
generating method: 

Position data point : An (x, y) integer pair representing the logical location of the 
device pointer relative to the upper left hand corner of the video display device. 

Time data point : An integer value within the range [0, 65535] that represents a time 
unit at which a corresponding position data point is generated. In an embodiment of 
the present invention, the time unit is expressed in milliseconds and represents the 
time differential from the immediately previous point. 

Pressure data point: An integer value within the range [0,255] that represents the 
pressure associated with a corresponding position data point. In an embodiment of 
the present technology, 0 represents no pressure and 255 represents the heaviest 
amount of pressure. 

Curve segment: A second degree Bezier curve, q^u), that is represented by a 
vector, u, of location curve points, u j( that are defined via the mathematical relation: 

flfi< Uj) - E V,(i) B di (Uj) (1) 

where d = 2, 

Uj represents a relative location along the curve. The values of u are real 
numbers u n such that 0 < u n < 1 , where n controls the resolution of the curve, 
B^u'^l -4) and 

V^i) are location curve descriptors. V^O) represents a starting point of the 
curve segment, X/^2) represents an ending point of the curve segment, V^l ) 
represents a shape descriptor represented in accordance with the following 
mathematical relation: 

q,(u k ) - V,(0)B 2fl (u k )- V,(2)B Z2 (u k ) 
1 " B 2A (u k ) 

where u k is the interval that represents the furthest distance from the starting and 
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ending points and can be determined via the following mathematical relation: 
max^ { |x 0 ,y 0 - x,y, | + |x,,y,. - x„,y n | } (3) 

where Xo,y 0 is the starting point of the curve segment, x„,y n is the ending point of the 
curve segment, and Xj.y, are all other location curve points in the curve segment. 

Stroke : The curve drawn by a user. A stroke is represented by a series of curve 
segments q 1>1 (u), q 1i2 (u), .... q 1>n (u). 

Location curve descriptors : Control points that define a curve segment and are 
defined above. 

Time curve : A series of time segments representing a time dimension associated 
with the user drawn stroke. 

Time segment: A second degree Bezier curve, q 2 (u), that is represented by a vector, 
u, of time curve points, Uj, that are defined via the mathematical relation: 

<7 2 (",) - £ m B dJ ty) (4) 

where d = 2, 

Uj represents a relative location along the curve. The values of u are real 
numbers u n such that 0 < u n < 1 , where n controls the resolution of the curve, 
B^u'jO -u) and 

V 2 (i) are time curve descriptors. V 2 (0) represents a starting time point, V 2 (2) 
represents an ending time point, V 2 (1) represents a shape descriptor represented in 
accordance with the following mathematical relation: 

q 2 (ux) - ^(°) 5 2,o(^)- y 2 ( 2 ) 5 2, 2 K) (5) 

where u k is the interval that represents the furthest distance from the starting and 
ending points and can be determined via the following mathematical relation: 
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max 0 ^ { |x 0l y 0 - x,,y,. | + |x y ,y,. - x ni y n \ } (6) 

where Xo,y 0 is the starting time point, x,,^ is the ending time point, and x^ are all 
other time curve points in the curve segment. 

Pressure curve : A series of pressure segments representing a pressure dimension 
associated with the user drawn stroke. 

Pressure segment: A second degree Bezier curve, q 3 (u), that is represented by a 
vector, u, of pressure curve points, u j( that are defined via the mathematical relation: 

<7 3 ("y) = £ HI) B dJ (up (7) 

where d - 2, 

Uj represents a relative location along the curve. The values of u are real 
numbers u n such that 0 < u n < 1 , where n controls the resolution of the curve, 
B dil = 1^,(1 -u^, and 

V 3 (i) are pressure curve descriptors. V 3 (0) represents a starting pressure curve 
point, V 3 (2) represents an ending pressure curve point, V 3 (1) represents a shape 
descriptor represented in accordance with the following mathematical relation: 

* { ) ~ B 2A {u k ) 

W here u k is the interval that represents the furthest distance from the starting and 
ending points and can be determined via the following mathematical relation: 

maxo^ { |x 0 ,y 0 - x„y, | + |x,,y, - x n ,y n | } (9) 



where Xo,y 0 is the starting pressure curve point, x n ,y n is the ending pressure curve 
point, and x^ are all other pressure curve points in the curve segment. 
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Fig. 5 illustrates the steps used in the curve generating method of an embodiment of 
the present invention. During a collaborative drawing session, a collaborator can 
draw a stroke utilizing a pointing device. The pointing device represents the locations 
pointed to by the user as a set of position data points. The position data points are 
integer value pairs (x,y) that represent the logical location of the device pointer 
relative to the upper left hand corner of the video device. The curve generation 
procedure 122 receives the position data points in real-time and simultaneously 
g enera tes curve points and curve descriptors (step 502). The details of the 
generation of the curve points and curve descriptors will be discussed below. 

The curve points are then used by the image generation procedure 124 to display the 
curve on the user's video display device or other I/O device (step 504). The curve 
descriptors are formatted and transmitted to the server computer 1 04 for broadcast to 
other collaborators (step 506). The server computer 104 receives this data and 
broadcasts it to the intended collaborators (step 508). A collaborator receives the 
transmission, generates the appropriate curve points that correspond to the curve 
descriptors, and displays the new image (step 510). 

Figs. 6A - 6E illustrate the curve generating method. The user's stroke is represented 
by a series of position data points that are represented as x,y integer pairs. The 
position data points are partitioned into curve segments and a Bezier curve is defined 
for each curve segment. The Bezier curve consists of a number of curve points which 
are used to display the resulting image. The number of curve points is a function of 
the curve's resolution. Coarsely drawn curves are represented by a smaller number 
of curve points than smoothly drawn curves. 

Referring to Fig. 6A, each integer pair (x,y) is received in real time by the curve 
engine 122. The first point (Xo,y 0 ) is denoted as the starting curve point of the first 
curve segment. The starting point is also the first curve descriptor V(0). Each 
subsequent point is analyzed to determine whether it is part of the first curve 
segment. Referring to Figs. 6B - 6C, this is done by determining the angle, 9, 
between the starting point, (Xo,y 0 ), and the previous data point (x^) and the starting 
point, (Xo.yo), and the current data point (x 2 ,y 2 ). If the angle 6 exceeds a 
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predetermined threshold, the previous data point (x^yj is made the ending point V(2) 
of one curve segment and the starting point V(0) of a new curve segment. The 
ending point V(2) is also a curve descriptor. In addition, a new curve segment is 
formed when the direction of the angle 8 is opposite of the direction of the previously- 
calculated angle. 

A third curve descriptor V(1 ) is generated to represent the shape or peak of the curve 
segment in accordance with equation (2) above. Fig. 6C illustrates the various curve 
segments formed from a user's stroke and their respective curve descriptors. The 
curve descriptors for each curve segment of a user's stroke is transmitted to the 
collaborators engaged in the drawing activity. 

A Bezier curve is formulated for each defined curve segment. The Bezier curve is 
represented as a series of curve points. A curve segment is displayed as a series of 
lines that connect the curve points as shown in Fig. 6D. Thus, the number of curve 
points determines the resolution of the curve. The curve points are transmitted to the 
image generation procedure 124 which displays the resulting curve as illustrated in 
Fig. 6E. 

In addition, time and pressure data points can be received from the pointing device 
along with the position data points. A time data point can be an integer pair 
representing a time value and an index. The time value can be within the range [0, 
65535] and is expressed in milliseconds. The index represents the order of a time 
data point relative to other time data points. The time data points are mapped into a 
set of time curve points and time curve descriptors. The time curve points are used 
along with the location data points to display the image in accordance with the natural 
style of a particular drawing tool. The time curve descriptors are transmitted to other 
collaborators along with the location curve descriptors and/or pressure curve 
descriptors in order to display the curve in the collaborator's whiteboard. 

Similarly, a pressure data point can be an integer pair representing a pressure value 
and an index. The pressure data point value can be within the range [0, 255]. The 
index represents the order of a pressure point relative to other pressure points. The 
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pressure data point is mapped into a set of pressure curve points and pressure curve 
descriptors. The pressure curve points are used along with the location curve points 
and/or time curve points to display the image in accordance with the natural style of a 
particular drawing tool. The pressure curve descriptors are transmitted to other 
collaborators along with the location and/or time curve descriptors in order to display 
the curve in the collaborator's whiteboard. 

Fig. 7 illustrates the steps used in generating a curve in an embodiment of the 
present technology. It should be noted that a user's stroke can include lines as well 
as curves and that the curve generation engine 122 can accommodate lines as well 
as curves. The following discussion focuses on curves and can be easily modified by 
one skilled in the art to accommodate lines. 

Further, the following discussion pertains to an embodiment where the pointing 
device retrieves location, time, and pressure data points from a user's stroke. In 
alternate embodiments, the pointing device would retrieve any combination of 
location data points and either time or pressure data points. One skilled in the art 
would be able to easily modify the discussed methodology to accommodate these 
alternate embodiments. In yet another embodiment, the time data points need not be 
extracted from the pointing device. The time data points can be calculated by the 
curve generation engine 122 using the location data points. This can be performed 
by calculating the distance between two successive location data points and mapping 
the distance into an appropriate time unit. In addition, other methodologies can be 
used to calculate time data points from the location data points. 

Referring to Fig. 7, the curve engine 122 receives in real time a number of data points 
(step 520) represented as follows: 

I j : location data point represented as (x,y). 

t j: time data point represented as (z 1f z 2 ) where z n is an integer value within 
the range [0,65535] and a time unit expressed in milliseconds and where z 2 
represents the index of the time data point relative to other time data points, 
p t : pressure data point represented as (p^ p 2 ) where p 1 is an integer value 
within the range [0, 255] and where p 2 represents the index of the pressure 
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data point relative to other pressure data points. 

V 1d (0), V 1(i (1), V^j (2): curve descriptors for curve segment j. 

V 2J (°)» V 2j v 2j ( 2 ) : curve descriptors for time curve segment j. 

V 3J (0), V 3J (1), V 3J (2): curve descriptors for pressure curve segment j. 

The curve engine procedure 122 determines if the received data points are the first 
set of data points (step 522). In this case (step 522-Y), the start and end curve 
descriptors V(0) and V(2) for each data point type is initialized as follows (step 524): 
V tJ (0) = V tJ (2) = I i ; V 2J (0) = V 2J (2) = t , ; V 3J (0) = V 3J (2) = p L (10) 

If the received data points are the second set of data points (step 526), the end curve 
descriptors are set to the respective second data point as follows (step 528): 

V tJ (2)= I,; V 2j (2)= t,; V 3J (2) = Pi . (11) 

For each subsequent set of data points, the direction of the curve and its growth is 
determined relative to the starting point or first curve descriptor (step 530) . This is 
performed by determining the angle between two secant lines representing the 
previous location data point and the current location data point (see Fig. 6B). This 
can be determined mathematically as follows: 

9 = arctan ((| y, - y 0 Hy 2 - Yol) - (1*1 -*ol " l x 2 ~*o\)) ( 12 > 

In addition the direction of the angle 6 is determined and compared with the direction 
of the immediately preceding calculated angle. The direction of the angle 8 is 
expressed as being either a clockwise direction or as a counter clockwise direction. 

The computed angle 6 and its direction is used to determine if the received location 
data point is past a critical point defining the current curve segment (step 532). This 
is determined by testing the computed angle 6 against a user-defined threshold. In 
an embodiment of the present technology this threshold is between the range (n/4, 
n/10). If the direction of the angle is opposite to the previously calculated angle, this 
will indicate that the received location data point is outside the realm of the current 
curve segment 
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If it is determined that the received data points define a new curve segment (step 
532-Y), the curve descriptors V(0) and V(2) are initialized to the respective data 
points as follows (step 534): 

V 1j+1 (2)= V 2J+1 (2)= t i; V 3J+1 (2) = Pi . 

V 1j+1 (0) = I M ; V 2j+1 (0) = t M ; V 3J+1 (0) = p M . (13) 

Otherwise (step 532-N), the appropriate curve descriptors and curve points are 
calculated (step 536). The V^l), V 2 (1), V 3 (1) curve descriptors are calculated as 
described in equations (2), (5), and (8) and the curve points q^u), q 2 (u) t and q 3 (u) are 
calculated as well as described in equations (1 ), (4) f and (7). 

Steps 520 - 536 are repeated until no more data points are received by the curve 
engine procedure 122 from the pointing device. This typically signifies the fact that 
the user has completed the stroke by removing the pointing device from the visual 
display device. 

Referring to Fig. 5, upon the completion of the above mentioned curve generating 
method, the curve descriptors are transmitted to the server computer for broadcast to 
the other collaborators (step 506). The transmission can be formatted to include the 
following: drawing tool indicator, location curve descriptors, time curve descriptors, 
and pressure curve descriptors. The drawing tool indicator specifies the particular 
drawing tool used to make the stroke. 

When a collaborator receives the curve descriptors, the curve engine 122 transforms 
the curve descriptors into a respective set of curve points in accordance with 
equations (1), (4), and (7). The curve points are then transmitted to the image 
generation procedure 124 which displays the curve in the collaborator's whiteboard. 

Image Generating Method 

Referring to Fig. 8, the image generation procedure 124 can receive three sets of 
curve points: a set of location curve points q 1(1 (u)...q 1tn (u); a set of time curve points 
q 21 (u)...q 2n (u); and a set of pressure curve points q 3l i(u)...q 3n (u) which it uses to 
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display the associated image 556. The image generation procedure 124 can utilize a 
scale procedure 550 to map the location curve points q 1 1 (u)...q 1 n (u) into suitable 
coordinates for the particular collaborator's visual display device. In addition, each 
drawing tool has associated with it one or more scale tables 552, 554 that are used to 
map the time curve points q 2 ,i(u)...q 2 ,n(u) and pressure curve points q 3l i(u)...q 3 ,n(u) into 
suitable color and dimension attributes associated with the video display device. 

The general curve and image generating methods associated with the collaborative 
design activity have now been disclosed. The present technology provides two 
additional capabilities that will now be discussed. Specifically the capability for 
erasing a displayed curve and the capability of automatically generating parallel lines 
from a single user's stroke. 

Erasure 

During a collaborative drawing session, a user can erase any lines or curves in the 
shared drawing. For illustration purposes, the situation where a user specifies two 
points indicating where a curve is to be erased will be described. However, it should 
be noted that the present technology can erase a line or curve in any number of 
locations. 

Referring to Figs. 9 -10, a user indicates with the pointing device two points 560, 562 
on the curve that define an area of the curve that is to be erased. These points 560, 
562 are received by the curve generating procedure 122 (step 570). The curve 
generating procedure 122 determines the effected curve segments and their 
associated curve descriptors (step 572). For the curve segment corresponding to the 
first erasure data point (step 574-Y), the curve segment's end point is adjusted to be 
first erasure data point. Likewise, for the curve segment corresponding to the second 
erasure data point (step 574-N), the curve segment's starting point is adjusted to be 
the second erasure data point (step 578). The appropriate curve data points q^u), 
Q2( u ). c l3( u ) representing the affected curve segments are recalculated as well as the 
V(1) curve descriptors in accordance with the aforementioned equations (step 580) 
(see Fig. 9B). Also, any curve segments located entirely between the deletion points 



WO 98/38594 



PCT/US98/02739 



-21 - 

560, 562 are deleted (step 580). 

The curve data points are then transmitted to the image generation procedure 124 to 
display the new image (see Fig. 9C). The curve descriptors for both of the newly 
generated curves are transmitted to the server computer 104 for broadcast to each 
collaborator. 

Parallel Curves 

Another facility of the present technology is the capability to automatically generate 
parallel lines or curves from a user's stroke. For illustration purposes, the following 
discussion will focus on the generation of two parallel curves. However, one skilled 
in the art can easily modify the described technique to generate parallel lines and 
multiple parallel lines and curves. 

A user traces the path of a curve with a pointing device. The curve is represented as 
a series of position data points. Each of the two parallel curves will be generated at 
an equal distance above and below the user's stroke. Time and/or pressure data 
points associated with the drawn curve are used to determine the distance between 
the parallel curves (see Fig. 1 1 A). In an alternate embodiment, the time data points 
need not be received from the pointing device. The time data points can be 
inferentially calculated by measuring the distance between two position data points 
•as previously described above. In addition, the time and/or pressure data points can 
also be used to effect the width, texture, and color hue of each of the parallel curves 
as previously described above. 

Referring to Fig. 12, a set of position data points (x^) and time and/or pressure data 
points are received from an I/O device 582. The time and/or pressure data points are 
mapped via a distance mapping procedure 134 into an appropriate distance measure 
d 4 . The distance is divided in half. The distance (d/2) and the position data points 
are transmitted simultaneously to two curve engines 122. The first curve engine 122a 
generates the curve points and curve descriptors for the top parallel curve and the 
second curve engine 122b generates the curve points and curve descriptors for the 
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bottom parallel curve. The curve points for both curves are then transmitted to the 
image generation procedure 124 which displays the parallel curves 584, 586 as 
shown in Fig. 12B. The curve descriptors are transmitted to the server computer 104 
for broadcast to the other collaborators. 

In an alternate embodiment, a user's stroke can be mapped into an image including 
two parallel curves where the area between the parallel curves includes a user- 
defined texture as shown in Fig. 1 1C, The above mentioned steps for generating 
parallel curves is used to generate two parallel curves. Next, a user-defined texture 
is drawn in the area between the curves. This texture can also be affected by the 
time and pressure data points associated with the user drawn stroke. Curve 
descriptors are computed for this set of parallel curves and are transmitted along with 
the texture data to the server computer 104 for broadcast to the other collaborators. 

Alternate Embodiments 

While the present invention has been described with reference to a few specific 
embodiments, the description is illustrative of the invention and is not to be construed 
as limiting the invention. Various modifications may occur to those skilled in the art 
without departing from the true spirit and scope of the invention as defined by the 
appended claims. 

The present invention is not limited to the computer system described in reference to 
Fig. 1. It may be practiced without the specific details and may be implemented in 
various configurations f or makes or models of distributed computing systems, tightly- 
coupled processors or in various configurations of loosely-coupled microprocessor 
systems. 

Further, the method and system described hereinabove is amenable for execution on 
various types of executable mediums other than a memory device such as a random 
access memory. Other types of executable mediums can be used, such as but not 
limited to, a computer readable storage medium which can be any memory device, 
compact disc, or floppy disk. 
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The present technology has been described with reference to curves and lines. 
However, the present technology is amenable to any two-dimensional graphic image. 
Furthermore, one skilled in the art can modify the above discussed technology to 
accommodate any n-dimensional graphic image. 
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WHAT IS CLAIMED IS: 

1 . A method for generating a curve in a distributed computing system including at 
least one client computer and at least one server computer, the method comprising 
the steps of: 

(a) providing one or more drawing tools for use by users associated with the 
client computers to draw a curve, each drawing tool having one or more style 
attributes associated therewith; 

(b) receiving a plurality of location data points representing a path of a curve 
drawn with one of the drawing tools; 

(c) mapping the location data points into a plurality of curve data points, the 
curve data points used to display the stroke in accordance with a specified image 
resolution; and 

(d) utilizing the curve data points to display the stroke in accordance with the 
stroke's associated drawing tool. 

2. The method of claim 1 , further comprising the steps of: 

generating one or more sets of curve descriptors, the curve descriptors 
representing a compact representation of the curve data points; and 

transmitting the curve descriptors to the server computer for broadcast to one 
or more of the client computers. 

3. The method of claim 2, further comprising the steps of: 

for each of the receiving client computers, converting the curve descriptors into 
a plurality of curve data points, the curve data points used to display the stroke in 
accordance with a specified resolution and in accordance with a specified drawing 
tool. 

4. The method of claim 1 , 
step (b) further including: 

receiving a plurality of temporal data points representing a speed at 
which portions of the curve was drawn; 
step (c) further including: 
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mapping the temporal data points into a plurality of temporal curve 
points, each of the temporal curve points associated with a corresponding curve data 
point; and 

step (d) further including: 

utilizing the temporal data points to display the stroke in accordance 
with the stroke's associated drawing tool. 

5 The method of claim 1 , wherein the temporal data points are calculated from a 
distance between consecutive location data points. 

6. The method of claim 1 , 
step (b) further including: 

receiving a plurality of pressure data points representing a pressure at 
which portions of the curve was drawn; 
step (c) further including: 

mapping the pressure data points into a plurality of pressure curve 
points, each pressure curve point associated with a corresponding curve data point; 
and 

step (d) further including: 

utilizing the pressure data points to display the stroke in accordance 
with the stroke's associated drawing tool. 

7. The method of claim 1 , 

the style attributes including width attributes and color attributes. 
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